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CENTRAL LIMIT THEOREM FOR A MANY-SERVER QUEUE 
WITH RANDOM SERVICE RATES 

By Rami Atar 

Technion — Israel Institute of Technology 

Given a random variable A*' with values in N, and A*' i.i.d. positive 
random variables {fJ,k}, we consider a queue with renewal arrivals 
and A'^ exponential servers, where server k serves at rate fik, under 
two work conserving routing schemes. In the first, the service rates 
{^fc} need not be known to the router, and each customer to arrive 
at a time when some servers are idle is routed to the server that 
has been idle for the longest time (or otherwise it is queued). In the 
second, the service rates are known to the router, and a customer that 
arrives to find idle servers is routed to the one whose service rate is 
greatest. In the many-server heavy traffic regime of Halfin and Whitt, 
the process that represents the number of customers in the system is 
shown to converge to a one-dimensional diffusion with a random drift 
coefficient, where the law of the drift depends on the routing scheme. 
A related result is also provided for nonrandom environments. 

1. Introduction. Many-server queues in heavy traffic have been the sub- 
ject of much research, both for their theoretical interest and for their im- 
portance in practical applications (a review of some of the more theoreti- 
cal results appears in Whitt [11]). Central limit theorem (CLT) results for 
such models are known under various settings, including ones where the 
servers are homogeneous and ones where they are heterogeneous, but mod- 
els in which the service rates are random have not so far been treated in 
a many-server CLT framework. Incorporating random service rates into a 
many-server setting appears to be a natural way to model uncertainty in 
the abilities of individual servers. This approach is taken here in analyzing 
a many-server, single class model under two routing policies. 

A CLT regime for a many-server queue was first studied in detail by Halfin 
and Whitt [5]. In this paper one considers a parameterization in which the 
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number of servers and the rate of arrivals are scaled up at a (nearly) fixed 
proportion under which the queue remains critically loaded. It is assumed 
that the arrivals occur according to a renewal process and that the servers all 
have exponential service time distribution of the same rate, and it is shown 
that the second-order asymptotics of the process representing the number 
of customers in the system, is given as a one-dimensional diffusion. It is well 
understood that one-dimensional diffusions are not to be expected when one 
relaxes the exponential assumption. Indeed, Puhalskii and Reiman [8] prove 
that an (n — l)-dimensional diffusion appears in the limit when the service 
time distribution is of phase type with n phases; Reed [9] and Kaspi and 
Ramanan [6] derive recursions in function space for general service time dis- 
tribution (for both fluid and diffusion limits). Similarly, when one keeps the 
exponential assumption but relaxes the server homogeneity assumption — a 
situation which occurs, in particular, when service rates are random — one 
does not in general obtain a one-dimensional diffusion limit (we do not prove 
this claim). Since one-dimensional diffusions constitute a significant simpli- 
fication that the model undergoes in the limit, it is desirable to understand 
when they occur. The focus of this paper is on models that feature exponen- 
tial servers with random rates, and give rise to one-dimensional diffusions. 

In the more conventional heavy traffic regime, where the arrival and ser- 
vice rates are scaled up but the number of servers is not, fluid and diffusion 
limit results have been proved in Choudhury et al. [4] for a random, time- 
varying environment setting. Besides the fact that the time-varying envi- 
ronment aspect is central in [4], the nature of these results is quite different 
from those of the current paper also in that in a many-server setting, the 
environment stochasticity that appears in the limiting diffusion process (in 
the form of a random drift coefficient) has an ingredient that originates from 
a CLT for the random service rates themselves. We also mention the fluid 
scale treatment of a many-server model in a setting of random environment, 
Whitt [10], where randomness enters in the number of servers and arrival 
rates. 

The model under study has a random number N of exponential servers 
with i.i.d. service rates Hk, k = 1, . . . , N . When customers arrive into the 
system they are either queued in a buffer with infinite room, or routed to a 
server according to a specified routing policy. Customers from the queue are 
routed to servers according to a first-come-first-served rule. Each customer 
leaves the system when its service requirement is fully processed. The rout- 
ing policies are work conserving, in the sense that no server may be idle when 
at least one customer is in the buffer. The service policy is noninterruptible 
(a term sometimes referred to as nonpreemptive), in the sense that each 
customer is assigned exactly one server, that then continuously processes its 
service requirement to completion. In the first routing policy under consid- 
eration, referred to as PI, the service rates {nk} need not be known to the 
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router, and each customer to arrive at a time when some servers are idle is 
routed to the server that has been idle for the longest time, or otherwise it 
is queued. Under the second routing policy, P2, the service rates are known 
to the router, and a customer that arrives to find idle servers is routed to 
the one whose service rate is greatest. In our main results (Theorems 2.1 
and 2.2) we find second-order asymptotics for the process that represents 
the number of customers in the system in the form of a one-dimensional 
diffusion with a random drift coefficient (that depends on the policy). 

By its very definition, policy PI expresses a form of fairness, because 
when several servers are free, the one selected for the next incoming job is 
the one that has been idle for the longest time. In addition, we will show 
that an asymptotic property of load balancing takes place, in the sense that 
when the load on the servers is relatively low so that some servers have to 
idle, they all experience idle periods of approximately the same length (as 
expressed by Proposition 2.1, which also identifies the asymptotic length of 
idle periods in terms of the limiting diffusion alluded to above). 

Armony [1] analyzes policy P2 (referred to in [1] as Fastest Server First) 
in a deterministic environment, where the service rates take a finite number 
of values. Our result on policy P2 (Theorem 2.2) is analogous to Proposi- 
tion 4.2 of [1], but a significant difference is the presence of a random drift 
term in the diffusion limit of our Theorem 2.2, originating from environment 
stochasticity. 

The result regarding policy PI (Theorem 2.1) may also be interesting in 
a deterministic environment setting, and thus we formulate such a version 
of it in Corollary 4.1. 

We point out that the phenomena which make the diffusion limit one- 
dimensional are very different under policies PI and P2. A heuristic discus- 
sion at the end of Section 2 explains the form of the limit processes in both 
cases. 

The organization of the paper is as follows. Section 2 contains a descrip- 
tion of the model, statement of the main results, namely Theorem 2.1 and 
Proposition 2.1 for the routing policy PI and Theorem 2.2 for P2, and a 
heuristic discussion. The proofs appear in Section 3. Finally, in Section 4 we 
analyze policy PI in deterministic environment. 

2. Model description and main results. We fix some notation. For a 
positive integer d, we denote by B(M'^) the space of functions from M+ to 
that are right continuous on M+ and have finite left limits on (0, oo) 
(RCLL), endowed with the usual Skorohod topology [3]. For X € ©(M'^) and 
t > 0, we denote AX{t) = X{t) - X{t-). If X"", n G N and X are processes 
with sample paths in ©(R'^) (resp., real- valued random variables) we write 
X" =^ X to denote weak convergence of the measures induced by on 
B(M'^) (resp., on R) to the measure induced by X, as n — > oo. For X G D(M) 
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we write \X\^,^t '■= supQ<g<( For a collection A of random variables, 

o"!^} denotes the sigma-field generated by this collection. 

We now rigorously describe the model: the servers and their rates, the 
initial configuration, the arrival process, and finally the routing policies. A 
complete probability space {^},J-,P) is given, supporting all random vari- 
ables and stochastic processes defined below. Expectation w.r.t. P is denoted 
by E. The model is parameterized by n G N. For each n, let A^" be a random 
variable with values in N, representing the number of servers. Let QlkiP'k), 
/c G N be M^-valued i.i.d. random variables, and let 

(2.1) ^4':=/Ife + n-i/%, k=l,...,N^ 

represent the service rate of server /c. It is assumed that are nonnegative. 
The marginal distribution of Jli (resp., Jli) is denoted by m (resp., m). It is 
also assumed that the random variables Jlk are nonnegative, and that 

(2.2) fi:= [ xdmG (0,oo). 

J[0,oo) 

The random variables are assumed to be bounded, namely -P(|/ii| < /u) = 
1, for some constant /I < oo. Also, the number of servers is assumed to be 
bounded by 2n, that is, P(A^" < 2n) = 1, and to be asymptotic to n, in the 
sense that N"'/n =^ 1. 

To describe the initial configuration, let Qq be a Z_|_-valued random vari- 
able, representing the initial number of customers in the buffer. Let -B^Q' 
k = l, . . . , N"' be {0, l}-valued random variables representing the initial state 
of each server as follows: = 1 if server k initially serves a customer. It is 
assumed that > if and only if = 1 for all /c = 1, ... , A^". We denote 

-^0 — Qo + J2k=i^k 0- This random variable represents the total number 
of customers initially in the system. By assumption, we have the relation 
Q^ = {XS-N^)+. 

The "second-order asymptotics" of the random variables Xq and A^", 
defined below, are assumed to satisfy 

(2.3) (Xo", iV-) := (n-i/2(Xo" - N^),n-'/\N^ - n)) (^o, u), 

where {Co^^) is an (K^)-valued random variable. 

The arrivals are modeled as renewal processes with finite second mo- 
ment for the interarrival time. To this end, we are given parameters A" > 0, 
n G N satisfying lim„, X^/n = A > 0, and a sequence of strictly positive i.i.d. 
random variables {IJ{l)J G N}, with mean EU{1) = 1 and variance C'^ = 

Var(?7(l)) G [0,cxd). With = 0) the number of arrivals up to time t for 
the nth system is given by 

^-(t)=sup|/>0:^^<4, t>0. 
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The "heavy traffic" condition assumed throughout, that makes the system 
criticahy loaded, relates the arrival and service rates as follows: 

(2.4) A = ^. 

The arrival rates are moreover assumed to satisfy the second-order relation 

(2.5) liinn-^/^{\'' -nX) = X, 

for some A G M. 

For each k = 1, . . . , A^"", we let BJ^: be a stochastic process taking values 
in {0, 1}, representing the status of server k. When B^{t) = 1 we say that 
server k is busy. For A; = 1, . . . , A^", let i?^ (resp., D^) be a Z+-valued with 
nondecreasing RCLL sample paths, representing the number of routings of 
customers to server k within [0, t] (resp., the number of jobs completed by 
server k by time t). Thus 

(2.6) Bl{t) = El, + Rl{t) - D^t), k = l,...,N,t>0. 

We let IJ^{t) = 1 - BJ^{t) for k = l,...,Af", and t > 0. The assumptions 
on depend on the routing policy, and will be specified later. To describe 
the processes D^, let {Sk,k £ N} be i.i.d. standard Poisson processes, each 
having right-continuous sample paths. The processes are assumed to 
satisfy 

(2.7) Dm = Sk{T^{t)), k = l,...,N^ 
where 

(2.8) T^{t) = ^il fBl{s)ds, k = l,...,N\ 

Jo 

The stochastic primitives introduced thus far are 

We have further assumptions regarding their joint law. First, it is assumed 
that the three random objects above are mutually independent. Moreover, 
{/ifc,/Ifc}fcgN and {A^",Xo}neN are assumed to be mutually independent. 
Note, in particular, that it is not assumed that {BJ^q} are independent of 

Let X", and be defined as 

AT" 

(2.9) X-{t) = XS + A-{t)-Y^D^{t), 

k=l 

AT" 

(2.10) Qn^t^ = Qn^A^^^t)-J2m), 

k=l 

N 

(2.11) I^{t) = J2im. 

k=l 
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These processes represent the number of customers in the system, the num- 
ber of customers in the buffer, and, respectively, the number of servers that 
are idle. It is assumed that the routing policy is work conserving, in the 
sense that 

(2.12) Q"(i) = (X"(t)-iV")+, /"(i) = (X"(t)-A^")". 

Finally we come to the routing mechanism. We denote by K^{t) the set 
of servers that are "available" at time t. This includes those that are idle 
at i— , and those that have just finished a job at time t. More precisely, let 
K^ = {k: B^Q = 0}. Then K"(0) = K^, and 

(2.13) K'\t) = {k : I^t-) = l}U{k: ADUt) = 1}, t> 0. 
Let, for t > 0, 

i?r"(t) = {sG(O,t]:K"(s)y^0} 

(2.14) 

n {s G (0, t] : Q"(s-) > or A^"(s) = 1} 

represent the set of routing times, that is, the set of times at which customers 
are routed to servers up to t. To define the first policy we need the following 
notation. Let 

(2.15) HJ!{t) = mi{s £ [0,t) : IJ!{u) = 1 iov all u£[s,t)} At, t>0. 

H'^{t) is equal to the last time prior to t when server k became idle if 
IJ}{t—) = 1, and it is equal to t otherwise. Also let 

(n 1 fi^ rruf.. _ / min{F,"(t) : k G Jf"(t)}, K^{t) / 0, 

[Z.W) tl K"(i)=0, 

and 

(2.17) h^{t)=t-H''{t). 

The policy that we now define routes a customer to the server that has been 
idle for the longest time since it last served, or to one of the servers that has 
been idle since time zero, if such servers exist. Thus, with 

(2.18) K"(t) = min{A: G K"(t) : /7^(t) = /7"(t)} 

if K^{t) is nonempty, and ^"(t) = otherwise, the routing processes are 
given as 

(2.19) i?^(t)= Yl l{."{.)=fe}- 

All the stochastic processes above are now well defined. More precisely, 
given n and the data {/i^}, iV", Xq, {BJ^q}, {Sk} and A^, there exists 
a unique process S^^ = (X", Q", I", i^", iiT", k", {S^, i?^, L>^, T^", i?^}) 



QUEUE WITH RANDOM SERVICE RATES 



7 



such that equations (2.6)-(2.19) are satisfied for all t > 0, a.s. The sample 
paths of the process = (^", X", Q", {S^, L>^, i2^}fc=i„,.,7V") are a.s. 
piecewise constant and right-continuous, and, a.s., each time t when one of 
the N"^ + 1 processes {{D^},A^'^) jumps, the size of the jump is one, and 
no one of the other A^" processes jumps at t. These facts can be proved 
by induction on the times at which one of the A^"" + 1 processes alluded to 
above jump, in a straightforward way, and the elementary proof is omitted. 
We refer to the process as policy PI. 

We let X"' be a centered, renormalized version of the process X", defined 

by 

Theorem 2.1. Assume Jx'^drh<oo. Then, under policy PI, the pro- 
cesses X" converge weakly to the unique solution ^ to the equation 

(2.20) e(i) = Co + (^w{t) +pt + -f e(s)~ ds, t > 0, 

Jo 

where = AC?, + ^ = /^(C?, + 1), (3 = X — p. — C — IJ-i^, P- = J ^ dm, Q is a nor- 
mal random variable with parameters {0, J {x — /i)"^ drh) , 7 = / x^dm/ J xdfh, 
the process w is a standard Brownian motion, and the three random objects 
(Co)i^); C 0,'nd w, are mutually independent. 

Remark 2.1. It is a standard fact that there exists a strong solution ^ 
to (2.20), adapted to the augmentation of the filtration a"{Co) /3} V a{ws ■ s < 
t} [7], Theorem V.3.7, and that it is strongly unique (uniqueness, in fact, 
holds in the class of all continuous processes). 

Remark 2.2. Let /" = n'^/^T and = n'^/^Q"-. Then by (2.12), it 
follows from Theorem 2.1 that (X",I",Q") =^ ,(,^), and thus the result 
regards also the limit behavior of the queue length and idleness processes. 

The length of the idle periods experienced by the servers can also be 
analyzed, and as shown by the result below, can be expressed in terms of 
the diffusion process The result also shows that a certain form of fairness is 
achieved. Roughly speaking, if at a certain moment s there are relatively few 
customers [in the sense that the limiting process satisfies (,{s) < 0], then the 
load is balanced among all servers that at or near s have become available, 
in such a way that they all experience an idle period of approximately the 
same length. 

To state the precise claim, we need the following notation. Given < s < t, 
[s,t) is said to be an idle period for server fc if at s it has finished serving 
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a customer, and at t it has started serving its next customer, t — s is the 
length of that idle period. If the above occurs with t = s, we regard it as an 
idle period of length zero. For < s < t, let denote the set of all servers 
that at some time u € [s,t] have finished an idle period. Let I" (A:) denote 
the length of the last idle period of server k, completed at or before time t 
(left undefined if no such idle period exists), and 

= sup{ir(A;) : k G K^, J, II, = inf{ink) : k G J. 

Proposition 2.1. Under the assumptions of Theorem 2.1, given s > 
and a sequence with tn> s, tn^ s and n^^'^{tn — s) — > oo, one has 

Remark 2.3. One can think of the policy under study as if servers 
that become available enter a queue and are assigned new jobs according 
to a FIFO discipline. Viewed this way, the above result expresses a form of 
sample-path Little's law. Indeed, the number of idle servers is asymptotic 
(in diffusion scale) to the average rate at which servers become idle is 
(in fluid scale) fi, and the time servers "wait for a job" is asymptotic (at 
diffusion scale) to the ratio 

The second routing scheme that we consider is defined as follows. It is 
assumed that the servers are re-ordered in such a way that /i" < ^2 — " " " — 
/j.'pfn. Recall the set-valued process K", representing the set of available 
servers (2.13). We let 

(2.21) K''{t)=ma^{keK''{t)}, 

if K{t) 7^ 0, and K{t) = otherwise [equation (2.21) is to be considered in 
place of (2.18)]. As before, let RT'' and be defined via (2.14) and (2.19). 
The policy under consideration thus selects for each customer the fastest 
server available at the time of routing. The precise definition of the policy 
is via equations (2.6)-(2.14), (2.19) and (2.21), and the processes 

i:^ = {X^,Q'',r,K^,RT^,K^,{Bj:,Rl,Dt,Tn) 

and 

Assertions analogous to those stated after equation (2.19), regarding the 
processes S", S" and equations (2.6)-(2.19), hold true for the processes 112) 
Eg and equations (2.6)-(2.14), (2.19) and (2.21). The process is referred 
to as policy P2. 
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For simplicity, we shall assume that the initial arrangement of customers 
is such that the faster servers are all busy, in the sense that 

(2-22) = l{fc>/jY}, 

where Iq = {Xq — A^")" is the initial number of idle servers. Denote Umin = 
essinf m and /imax = ess sup m. 

Theorem 2.2. Assume ^max < oo. Let the initial configuration satisfy 

(2.22) . Then, under policy P2, the processes converge weakly to the 
unique solution ^ to the equation 

(2.23) ^(t)=Co + aw{t)+(3t + fi,,,n, f\{s)-ds, t > 0, 

Jo 

where {a,P,w) are as in Theorem 2.1. 

Note that Remarks 2.1 and 2.2 apply to policy P2 as well. 
We end this section with a heuristic explanation of the form of the limiting 
processes. By calculation [cf. (3.8)-(3.12)], the process X" satisfies 

(2.24) l"(t) =X^ + Wit) + rt + F"(t), 
where 

F^{t)=n-^'^Y.I^k / h{s)ds. 

For the policies under consideration, we show that VF" converges to a Brown- 
ian motion and 6" to a random variable. The term F"" expresses decrease 
of processing rate due to idleness. It is the limit behavior of this term that 
differs from one policy to another, and whether it can be well approximated 
by a quantity of the form /g c(X"(s)) ds will determine if the limit is a one- 
dimensional diff'usion. To give an idea on why behaves as stated in the 
above results, consider first policy PI and let I{t; Ax) denote the number of 
servers with [x,x + Aj;)-valued service rate, that are idle at time t, where 
Ax is relatively small. Because the service time distribution of the relevant 
servers is exponential with rate x approximately, and their number is roughly 
Nfh{[x, x + Ax)), the number of servers with [x, x -\- Ax)-valued service rate 
that become idle on a time interval [o, b) is roughly Poisson with parameter 
Niri{[x,x + Ax))x{b — a). Therefore a first-order approximation for / is 

(2.25) I{t; Ax) Nm{[x,x + Ax))xh'^{t). 
With N ^ n, we have 

TV 

71-1/2 ~ / ^ ni/2/i"(t) / x^midx). 

k=i '' •' 
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Similarly 

N 

r{t) = ^ j^(^) ^ n^l'^h^{t) / xfh{dx) 
k=i •' 

hence 

j xm{dx) Jo Jo 

which, along with (2.24) explains the limit (2.20). 

A rigorous version of the rough equality (2.25), on which this heuristic 
argument is built, can be found in the proof of Theorem 2.1 [i.e., (3.15) and 
the proven smallness of the (integrated) error terms in this equation]. 

For policy P2, the selection of free servers with higher rates encourages 
idleness among the servers with lowest rates, and this results in 

(2.26) /(t; Ax) = o(n^/^) for any x > /imin , 

hence in the approximate equality 

F" « /' /"(s) ds = f X^{s)- ds. 
Jo Jo 

This explains the limit (2.23). A rigorous statement of (2.26) appears in 
(3.26) as a part of the proof of Theorem 2.2. This phenomenon is similar to 
what appears in [1] in the case of a deterministic environment and a finite 
number of server pools, and the reader is referred to this reference for further 
discussion. 

3. Proofs. For simplicity, we will omit the symbol n from the notation 
of all random variables and stochastic processes. There will be no confusion 
with variables and processes that do not depend on n. The deterministic 
parameters that depend on n will still have superscript n in their notation. 

The proposition below provides a tool by which one can replace the Pois- 
son processes that drive the service processes of the individual servers by 
ones that jointly drive service processes of collections of servers. 

Proposition 3.1. Fixn G N. Let {Ki, . . .,Kq) be apartition of {I, ...,N) 
that is measurable on cr{A^, {/Ifci A*fc}}- Let {S^^\ . . . , S^"^^} be independent 
standard Poisson processes. For each i = 1, . . . ,q and for each nonempty 
subset J of Ki, let {e{i,J,l),l € N} be a sequence of i.i.d. random variables 
distributed uniformly on J, independent across i and J . Assume also that 
the four random objects {N,{Jlk,flk},XQ,{Bkfi}), A, {S^^^} and {e{i,J,l)} 
are mutually independent. Define 

(3.1) I)«(t) = 5«(r«(t)), i = l,...,q, 
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where 

(3.2) r»(t)= ^ rfc(t), i = l,...,q, 
and consider 

(3.3) Dk{t)= ^ l{e(i,{pei<-i:-Bp{s-)=l},-DW(s))=fc}, 

se{0,t]:AD(*){s)=l 

keKi,i = l,...,q 

as a substitute for equation (2.7). Then the process S'^, defined analogously 
to Si, with (3.1)-(3.3) in place of (2.7), is equal in law to Si. Similarly, 
the process S2 defined analogously to S2, with (3.1)-(3.3) in place of (2.7), 
is equal in law to S2. 

This proposition is basically a statement about superposition of Poisson 
processes. We omit the elementary proof. 

Let S denote a standard Poisson process, and set 

(3.4) I(t) = n-i/2(^(i)_A"t), t>0, 

(3.5) S{t)=n~^/^{S{nt)-nt), t>0. 

We will use in what follows the well-known fact that both A and S converge 
weakly to a zero mean Brownian motion with diffusion coefficient X^^'^Cfy, 
and respectively, 1 (see e.g. Lemmas 2 and 4(i) of [2]). 

Proof of Theorem 2.1. Let e > be given and let q' G N and /i^*) G 
IR+, i = 1, . . . ,g be numbers satisfying the following conditions: 

• ^(1) = 0, ^(9) > 1^ 

• 0</xW <£, i=l,...,q, 

• for i = 2, . . . ,q, fi^^^ is a continuity point of x i-^ m([0,a;]) = P{ni < x). 
Set = oo, and denote = [fi^'^\ fi^^^^^) for i = 1, . . . , q. Let 

(3.6) Ki = {ke{l,...,N}:fik^r,}, i = l,...,q. 

Using equations (2.4) and (2.9), and Proposition 3.1 with the above Ki, 
write 

(3.7) X{t) = Xo + n-i/2^(t) - 5«(r(')(t)) 

i=l 

(3.8) =Xo + W{t) + bt + F{t), 
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where 

1=1 

^-i/2(^(i)(2-W(t)) _ r(^)(t)), i=l,...,q, 
b{n) = n-^/'^{X'' -nX) 

N N 

k=l k=l 

F-'%t)=n-'/'HY.^,,t-T(^Ht)) 

i=l \keKi J 

^-1/2 / y2fJ-kIk{s)ds. 
/»(t)= Ik{t), i = l,...,g. 

k(^Ki 

Let i be such that H[t) > 0. By (2.15) and (2.16), and since departures from 
different servers do not occur at the same time, we have that Ik{t—) = 1 if 
and only if Hk{t) € [H{t),t), which in turn occurs if and only if AZ)fc(s) = 1 
for some s £ [H{t),t). Let k be such that H{t) = H~{t). Note that, for a given 
k, it is impossible to have that ADk{s) = 1 for more than one s € [H{t),t), 
since this would mean that a departure from server k and a routing to 
this server have taken place some time at si and, respectively, S2, where 
H{t) <si<S2<t, thus by (2.18) and (2.19), Hk{s2) < H~{s2) = H{t), which 
contradicts Hk{s2) > si > H{t). Writing #C for the cardinality of a set C, 
we therefore have for t such that H[t) > 0, 

l{i)(t-) = #{k(^K,:Hk{t)(^[H{t),t)} 

= #{k £ Ki-.ADkis) = 1 for some s £ [H{t),t)} 
= 2)«(t_)_/)W(^(i)_). 

In case when H(t) = one has to add those servers that were idle through- 
out the interval [0,t). Thus, with the convention that, for any process L, 
L{H{t)-) = L(0) if H{t) = 0, we have I»(t-) = D«(t-) - D^'\H{t)-) + 
eQ^(t), where 

el{t) = #{k G Ki : 4(s) = 1 for ah s € [0, t)}. 



(3.9) W{t) = 

(3.10) W^^{t) = 

b = 

(3.11) 

Fit) = 

(3.12) 

Denote 
(3.13) 
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Note that 

(3.14) ^ej,(t) := ^n-V2e. (i) < n~^/^im{Hit)=o} = X^l{Hit)=oy 

i=l i=l 

Denote S^^{t) = n~^l'^{S^Hnt) - nt), = n-V2/(i), = n-^/'^h, Bk = 
n-^/^Bk. Also, recall h{t) = t - H{t) and let N^'^ = #Ki. Then 

/»(t-) = n-i/2(5W(T»(t-))-5(*)(r»(F(t)-))) + e*oW 

(3.15) 

= £»(t)+n-i/V*)Ar«/i(i), 

where 

£W(t) = [l^W(t-) - l^«(i/(t)-)] 
(3.16) + i^^k-^i^"^) t Bk{s)ds 

JH(t) 



keKi 

Using (3.15), one can express h in terms of J2i 1-^^^^ 

and then use (3.15) again to obtain an expression for each /^*^ that does not 
involve h. Along with (3.12), this yields the following expression for F: 

(3.17) F{t) = ^ f I{s)ds + e{t), 







where e{t) = ei{t) + e2{t) + e3(t) + e4(f), and 

1=1 keKi •'^ 

e2(t) = E/^^*^ tE^'Hs)ds, 
i=i ^0 

with the convention that when the denominator in the expressions for 63 
and 64 is zero, one lets 63(1) = and 64(1) = —7 jQl{s)ds. Hence by (3.8) 
and (2.12), we have 

(3.18) X{t) =Xo + W{t) + 6t + 7 r X{s)- ds + e{t). 

Jo 
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Recall that, by construction, the partition (3.6) depends on e, and as a result, 
so do the processes X [given in equation (3.7)] and W [defined in equation 
(3.9)]. However, Proposition 3.1 asserts that, for each n, the law of S'^ does 
not depend on the partition, and since W is defined only in terms of the 
processes A, Y.t=iS^^ {T^^ {■)) =Y.k=iDk ^nd T = J:Ut(^^ = ELiU = 
J2k=i /^fc /o Bk{s) ds, we see that the joint law of X = X"'^ and W = W"^'^ 
does not depend on e. This observation is used several times below. 

If a{n,£), n E N, e G (0, 1) is a family of real- valued random variables, we 
write a € if for every positive 5 and 5' there exists an e such that 

limsupP(|a(n,e)| > 6) < 6'. 

n^oo 

Fix t > throughout. Define 

61 = 6'(n, e) = inf{t: |e(t) I >l}At. 
Our main estimate is the following: 

Lemma 3.1. (i) One hash ^(3. 

(ii) Fixe. Then for i = 1, ... ,q, sup{\n~^T^^\t) — pit\:t < 9} ^ in 
probability, as n — > oo, where pi = J^, xdfh. 

(iii) For j = 1,2,3,4, |ej|,,9 G A/".' 

The proof of this lemma appears later. We can now complete the proof of 
the theorem. Note first that, by Lemma 3.1(iii), \e\^^g G A/". However, since 
the joint law of b, X and W does not depend on e, it follows from (3.18) that 
neither does the law of e. As a result, the statement \e\^^Q G M simply asserts 
that, for every e, |e|*^e ^ in probability. By definition of 9, we therefore 
have that, for every e, 

(3.19) P{9<t)^0 asn^oo, 

and thus |e|^ f — > in probability, as n — > cx). In what follows, we fix e. 
By (3.10) and the definition of S^'\ 

(3.20) T^W(t)=5W(n-ir«(t)), i = l,...,q. 

From Lemma 3.1(ii) we now have that n-i(r(^), . . . , T^^)) — /O in probability, 
uniformly on [0, t] , where p{t) = {pit, ... , pqt) . Recall that {A, S^^^ , S^''^ ) 
are mutually independent, and that S^^^ (resp.. A) converges to a standard 
Brownian motion (a zero-mean Brownian motion with diffusion coefficient 
X^^^Cfj). Thus (3.9), (3.20) and the lemma on random change of time [3, p. 
151] show that W converges weakly to aw, in the uniform topology on [0,t], 
where tt) is a standard Brownian motion and cr^ = AC? -|- p. 
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Finally, by the Skorohod representation theorem, we can assume without 
loss of generality that the random variables Xq, b, S^q and /3, and the processes 
W and w are realized in such a way that 

(3.21) {XQ,b,W) ^ {(,0, (3,aw) in probability, as n oo. 

Let ^ be the unique strong solution to equation (2.20) with data {£,o,(3,w). 
Combining (2.20) and (3.18), the inequality \x~ — y~\ < \x — y\, and Gron- 
wall's inequality shows 

1^ - ekf < (1^0 - eol + \b-(3\ + \W- awl J + \el,t) exp{^t). 

By (3.21) and the uniform convergence of e to zero, we have shown that X 
converges to in probability, uniformly on [0, t\ . Since i is arbitrary, this 
shows X ^ ^, and the result follows. □ 

Proof of Lemma 3.1. We begin by showing that 6=^/?. By the as- 
sumption (2.3) on N, and the central limit theorem and the law of large 
numbers for i.i.d. random variables, the second and third terms in (3.11) 
converge to the random variable — ^ and, respectively, the constant —p, from 
the statement of the theorem. Thus by (2.5) and (2.3), 6=^/3. This proves 
part (i) of the lemma. 

Recall that W'^'^ are given in (3.20). We show that the random variables 
{\W^i)l^j,i = l,...,q,n£n} are tight. By (2.1) and (2.8), for i G N, 

(3.22) ^ 

- n"^ y2 Ikis)ds. 

Note that N^'^^ /n ^ m{ri) as n ^ oo. Since by construction each fi^^^ is 
a continuity point of x i-^ m[0, a;], using the law of large numbers we have 
/" := J2k-'Ji^.£ri ^k ^ /r, xdm = pi. Denoting by u^t the first term on the 
r.h.s. of (3.22), it is easy to see by (2.1) that — converge weakly to 
zero. For t < t, the second term is bounded by n~^l'^pji for all n suffi- 
ciently large. Since the third term is negative, we have from (3.20) that 
|W^^*^|*,f < l*?^*^ By the tightness of S^*^ (as processes that converge 
to a Brownian motion) and the tightness of n", we have the tightness of 

Next, note that |e|,,^5i < 1. Thus the tightness of the random variables Xq, 

6, f ^iid 1^1* f ) £ (as follows from the convergence of ^4), and an 

application of Gronwall's lemma on (3.18), by which 

\Xl,e < {\Xo\ + \WU^e + \b\i+ l)exp(7t), 
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imply that 0,n € N} are tight. Since by (2.12), / = X~ , we also have 

that {|/|*^6i,n G N} are tight. 

Equipped with the tightness of we can prove part (ii) of the lemma, 

and moreover, show that the stopped processes {VF*-*^ (• A 0), i = 1, . . . , g, n G 
N} are C-tight. Fix e. For z = 1, . . . , g, we show that the supremum over t<9 
of the last term in (3.22) (in absolute value) converges to zero in probability, 
as n — > oo. Indeed, using Cauchy-Schwarz inequality for each s and the fact 
that Ik{s) takes values in {0, 1}, this term is bounded, for t < 0, by 

„j / TV \ 1/2 / N \ 1/2 

Note that n~'^Y^^=l^^\ =^ / drh < oo, and thus the asserted estimate on 
the last term of (3.22) follows from the tightness of \I\^^e- Denote by w the 
modulus of continuity 

Wr{x,6)= sup \x{s) — x{t)\, 6>0, 

\s~t\<5;s,te[0,T] 

for X : [0, r] — > M. By the discussion following display (3.22), we now have that 
sup{|n-^rW(t) - pit\:t< 6*} ^ in probability as n ^ oo, and part (ii) of 
the lemma follows. Consequently, the convergence of limsup^^oo 
S') to zero as (5 — > 0, for arbitrary 6' , follows from (3.20) and the C-tightness 
of In view of the tightness of the random variables IVK^'^I*,^ established 
above, this shows that for i = 1, . . . , g, {VF(*)(- A6),n € N} are C-tight. 
We now show that 

(3.23) {n^/2|/ij*,e,neN} are tight. 

To this end, consider the event {|/i|4,,6i > a} for a given n, and a given positive 
constant a. On this event, there exists t <6 such that at least one server is 
idle throughout the time interval [H{t),t) [recall the definition of H, and that 
h{t) = t — H(t)]. The routing policy under consideration routes customers 
to servers at the order at which servers become available. Consequently, if 
a certain server is idle throughout a given interval [ti,t2) then all arrivals 
between ti and t2 are necessarily routed to servers that were already idle at 
time ti. On the event indicated above, it follows that the number of arrivals 
between the times H(t) and t is less than the number of idle servers at time 
H[t). Hence, on this event, 

A{t) -A{t-a)-l< A{t-) - A{H{t)-) < \I\^^e- 

Substituting aQn~^^'^ for a (where oq is a constant) and noting that A" > 
An/2 for all n sufficiently large, we thus have by (3.4) 

P{n^/^\hU^e > ao) < pf inf [^(t) - A{{t - aon~^/^) V 0)] < -l) 



QUEUE WITH RANDOM SERVICE RATES 



17 



+ P(|I|*,e>aoA/4), 

for all sufficiently large n. Since, as we mentioned earlier, A converge to 
a Brownian motion, they are C-tight. Therefore the first term on the r.h.s. 
above tends to zero as n — > oo, for any fixed qq. Thus, in view of the tightness 
of {|I|^=^6i,n G N} which we have proved, (3.23) follows. 

We now estimate ei. Given a time t <9, a, particular server k has com- 
pleted Dj^{t) services by time t, and therefore there have been at most + 1 
idle periods by that time, that is, at most + 1 time intervals [n, u') C [0, t) 
such that Ik{s) = 1 for s G [u,n'), and inf[„,;/)/fc = for any [v^v') C [0,t), 
[u,u') C [v,v'). Since the length of each idle period is bounded by |/i|*,6» [by 
definition of H{t) and we have from (2.7) and (2.8), 

r h{s) ds < [Dkit) + l)\hl^e < {Skifikt) + l)\hU,s, k = l,...,N, 
Jo 

provided t <6. Hence 

4it)-= / l^klk{s)ds<n~'^/'^\h\^fi ^ fik{SkifJ'kt) + l)- 

Denoting 

M = n-i ^ik{Sk{^ikt) + l), 

keKq 

we have E[M] < 2f£'[(/xi)^l|^^gj._^}.], and using (2.1) and the third bullet in 
the definition of {fi^^^}, this can be bounded by ce, where c does not depend 
on n or e. Hence given a> and 6 > 0, 

Pi\elU,e >S)< P{n'^/^\hU^e > «) + ^(M > S/a), 

and the tightness of n^/'^\h\^^g and the fact that their law does not depend 
on £ imply that \ei\^£ € AA. Now ei is bounded above by 

ei + E E £ / Tk{s)ds<el+e f T{s)ds, 

and so the tightness of and the fact that their law does not depend on 
£ imply that |ei|*^6i £j\f. 

Consider now the expression (3.16) for E^'\ Note that sup{\W^'\t-) - 
W^^\H{t)-)\:t <e}< we{W^^\\hU,g). Thus the C-tightness of the pro- 
cesses Vl^(') stopped at 9 and (3.23) imply that the first term on the r.h.s. of 
(3.16), stopped at 9, converges uniformly on [0,t\ to zero in probability as 
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oo. As a result, so does el ■■=El=i f^^'^W^'Ht-) " W^'\H{t)-)]. Next, 



n 



^1 AtW 1 ■ 



n n , 
2=1 fcs-K:, 
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The expression in square brackets converges weakly to £j2i<q f^^^^^'^i'^^i) + 
/^^ dm < e /jQ j^-j X dm + e. Since n^/^ g are tight and their law does not 
depend on e, we see that |e2|*,6» G-A/". Moreover, with 



JH{i) 



i=l keK. 

(3.23) and the tightness of |/|*,6» imply that |e2|*,6» converges to zero in prob- 
ability as n— 5- oo. Finally, by (3.14) and (3.23), 

y^/U^*W e^(s)(is < /i'^'^)|Xo||/i|* 9 — in probability, as n —s- oo. 

The above estimate, along with the results regarding e\, and imply 
that |e2|*,6» S A/". 

Next, since N^^^ /n ^ fh{ri), it is clear that 

(3.24) c,(n):=n"i^(^«)%»^^(^»)Mn)=:Cj, j = l,2. 

j=l i=l 

Since |ci — / xdm| < X]i<ij ^"'-(^i) + Irg^dfh < 2e, and |c2 — / x'^ d7n\ < 
J2i<q 2s Jr^ ^ dm + /^^ x^ dm < 2e^ + e, we see that 

(3.25) C2(n)/ci(n) -7GAr. 

Along with the tightness of and the fact that its law does not depend 
on e, (3.25) shows that |e4|=i,^0 € A/". An argument similar to the one for 62 
shows that \ J2i=i Jq E^^\s) ds\^^g €J\f. Clearly, this and (3.25) imply that 
|e3|*,e G AT. This completes the proof of part (iii) of the lemma. □ 



Proof of Proposition 2.1. By the way the policy is defined, if a 
server k finishes an idle period at time u then the length of its idle period 
is equal to h'^{u—). Moreover, since n^^'^{tn — s) ^ 00, it follows from the 
representation to the departure process (3.1), and Lemma 3.1(ii), that K^^^ 
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is nonempty with probability tending to 1. Hence, with probabihty tending 
to 1, 

mf{h{u-) ■.S<U<tn} < Is^tn < Is.tn < SUp{/l(u-) ■.S<U< tn}. 

Denoting h{t) = n^/^h{t) and E{t) =Y.^E'''\t), we have by (3.15) 

T{t-) = E{t) +h{t)ci{n), 

where ci(n) is as in (3.24). Since by the proof of Theorem 2.1 and Lemma 
3.1, / =^ and ci(n) — € Af, and since ^ has continuous sample paths, 
it suffices to prove that ii^ — > in probability, uniformly over [s,t], for every 

< s < t. By (3.23), for fixed s > 0, P{H{s) = 0, 6* > s) ^ as n ^ oo. Hence 
by (3.14), one has sup{eo(n) : s < n < t} — > in probability. In conjunction 
with the estimates on the terms 62, and in the proof of Lemma 3.1, 
this establishes the convergence of E alluded to above, hence the result. □ 

Proof of Theorem 2.2. Let e > be given. Let /.t^^) = (yUmin - e) V 0, 
/i^^-* € (/Umini /^min + e) and fM^^^ = /imax + where /i*-^^ is a continuity point 
of X fh{[0,x]). Let ri = fj,^'^^) and r2 = /x^'^^), and set 

Ki = {ke{l,...,N}:fik^ri}, i = l,2. 

Equations (3.7)~(3.12) are valid, with q = 2. We keep the notation 7*^*^ for 

1 = l,2 (3.13), and = ri-i/2j(i)_ j^. shown below that, given t > 
and e > 0, 

(3.26) 1^ f ^ in probability, as n — > 00. 

Based on (3.26), the argument presented here for Theorem 2.2 follows steps 
that are similar to those of the proof of Theorem 2.1, and are, in fact, much 
simpler. First, by (3.8) and (3.12), one has 

(3.27) X{t) =Xo + W{t) + bt + fi^in t X{sy ds + e(t), 

Jo 

where 

^ ft ^ 

(3.28) e(t) = V(/Ufc - //min) / Ik{s)ds. 

k=i ^0 

Denote 6 = inf{t > : \e{t) \ > 1} A t. The property [3 \s proved as in the 
proof of Lemma 3.1. Also, the tightness of the random var iables{|VF«| 
N}, and as a result, that of {|X|*^0,n € N} and G N} is argued ex- 

actly as in the proof of Lemma 3.1. The supremum over t <9 oi the absolute 
value of the last term in (3.22) converges to zero in probability, since yUfc are 
assumed to be bounded and |/|*,6i are tight. In view of this, the argument 
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following (3.22) shows that, for i = 1, 2, sup{\n~^T^^'> (t) - pit\ : t < 6*} ^ in 
probability, as ?i — > oo. 

Now, by (3.28), |e|,,e < 2et|/|,,e + (/x^ax + eW'^^^ U,h and thus by (3.26), 
\e\*^B S A/". Since the law of e and 6 does not depend on e, we have that 
— > in probability, as n — > oo, for any fixed e. Given these facts, the 
completion of the proof is carried out precisely as in the proof of Theorem 
2.1. 

We now show (3.26). Note first that the probability of the event rji := 
{/(^^(O) = 0} converges to one as n — > oo. Indeed, since m(ri) > and fi^"^^ 
is a continuity point of a; i— > m([0,x]), we have that N^^^ /n =^ m(ri) > 0. 
Moreover, l(0)/n ^ by (2.3) and (2.12). Hence P{{k € i^i :5fc,o = 1} / 
0) ^ 1 as n — > oo, and by the assumption (2.22) we have that -P(?7i) ^ 1 as 
n — > oo. 

Given u> 0, consider now the event rj := {|/^^^ |* f > 2un^^'^}. On the event 
r] rir]i one can find < s < t < t such that I^'^\y) > for y S [s,t], and 
I^'^\t) — /(^^(s) > wn}/"^ . Since the servers in K2 all have greater rate than 
those in Ki, the routing policy assigns all arrivals within to K2 servers. 
Hence by (2.6), (2.7), (2.9), (2.11), (3.1), we have 

and therefore 

u < 5(2) (n-ir(2) (t)) - 5(2) (n-ir(2) (s)) - A{t) + A{s) 

+ ^ /ife l"Bk{y)dy-Xn'/\t-s)-n~'/\y' -\){t-s). 
fceA'2 " 

We have by (2.8) and (3.2) that n~^T^'^\t) < 3/Xmaxi =: r. Also, by (2.5), 
the last term above is bounded by c(t — s) for some constant c independent 
of n and e. Hence on the event riDrji, with 6 = t — s, 

(3.29) u < WriS^^'^ , 2/imax'5) + %(i, <5) + e)6 + c5, 

where C{n,e) = n~^J2kGK2 ~ (2-1)) (2-4), (2.3) and the definition 

of K2, C{n,e) — > —g{s) in probability, as n — > 00, where (7(e) = /^.^ 2; dm > 0. 
We obtain 

P(|P)|^ _> 2^x) =P(,7) <Pi(n,£,n) +P2(n,e,n) +P(r?J), 

where 

Pj{n,e,u) = P(there exists 5 € Aj such that (3.29) holds), j = 1,2, 

and Ai = (0,n~^/^], A2 = (n~^/^,t). Given e and ti, we have lim„Pj =0 for 
j = 1,2, by C-tightness of 5"^^^ and A, and the strict negativity of the weak 
limit of C. Since lim„ P{r]i) = and u > is arbitrary, statement (3.26) 
follows. This completes the proof of the theorem. □ 
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4. Policy PI in deterministic environment. The main difficulty dealt 
with in proving Theorem 2.1 is perhaps not in the randomness of the service 
rates but in establishing the reduction to a one-dimensional process. We 
would therefore like to present a version of Theorem 2.1 in a deterministic 
environment that follows upon minor modifications. We consider here the 
following setting. We assume that A^*^ = n for all n, and, in place of (2.1), 
model the service rates as deterministic, nonnegative constants 

(4.1) /i^ = /I^ + n-V2^^, k = l,...,n. 

The definition of the constants (/Jfc,/ifc) is based on a given probability mea- 
sure m, supported on a finite set M = {Mi, . . . , Ml} C M+ x M. Denote 
Ml = {Ml, Ml) for / = 1, . . . , L. With pi := m{Mi), I = 1, . . . ,L, the constants 
{Ji^,'p^) are assumed to have values in M and to satisfy 

(4.2) \#{k:{Til,ill) = Mi]-npi\<c, Z = 1, . . . , L, n E N, 

where c is a constant that does not depend on n and k. The marginals 
of m are denoted by ffi and fh, and, as in (2.2), ffi is assumed to satisfy 
fi := J X dm = Y^iPiMi £ (0, oo). With the exception that the constants (4.1) 
replace the random variables (2.1), we keep here the complete setting of 
Section 1, including the definition of policy PI, that in the current setting 
will be denoted by PI'. Note that due to our assumption on N^, the constant 
v is zero. 

Corollary 4.1. Under policy Pi', the processes converge weakly 
to the unique solution to the equation 

^{t) = Co + (^w{t) +(3t + -f f C(s)" ds, t > 0, 

Jo 

where = XC'^ + jj., (3 = X — ]!, p, = J xdfh = J^iPi^h 1 = I x"^ dm/ J xdrfi = 
"^iPiMf / ^iPiMi, andw is a standard Brownian motion, independent o/^o- 

Proof. The proof proceeds as that of Theorem 2.1, with trivial modi- 
fications, given the observations below. 

In Proposition 3.1, "a partition measurable on cj{A^, {^Ufc, /Ifc}}" reduces 
to "a deterministic partition." 

With the notation of Section 3, we have by (4.2) that n~^N^^^ = m{ri) + 
0(?i~^) as n — 5- oo. Hence provided that e is sufficiently small we have 
n~^N^'^^ m{ri), and for j = 1, 2, n"^ Efc-^'^erj(/^fc)'' ~^ dm, and more- 
over n~^/^ Ylk=i{V'lt ~ /^) ~* 0) as n — > oo. Similarly, Z]fc=i P-k^I^ dm 
as n ^ oo. 

The third bullet in the definition of the partition (see the ffist paragraph 
in the proof of Theorem 2.1) forces that J^^{q) x"^ dm = 0. This trivializes 
the treatment of e\ in Lemma 3.1, since this term is zero. □ 
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